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Abstract. Using a variant of the interpolating Hamiltonian technique, we show 
that there exists, in the Sherrington-Kirkpatrick spin glass, an exact connection 
between the sample-to-sample fluctuations of the free energy and bond chaos 
involving 2- and 4-replica overlaps between replicas with different but correlated 
bonds. This relation is used to derive an upper bound of the fluctuations. 
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1. Introduction 

Extreme value statistics is a very active field in current mathematical physics since the 
discovery of the Tracy- Widom distribution for the largest (or smallest) eigenvalue of 
a Gaussian random matrix, see [T] for an overview. The Tracy- Widom distribution is 
believed to consitute a new universality class for extreme values in addition to the three 
"classical" ones (Weibull, Gumbel, Frechet). There are however many cases which do 
not fall in any of these four classes. One important example is the distribution of 
ground state energies in the Sherrington-Kirkpatrick model [2]. Despite tremendous 
numerical effort over the years [3J, [4l El [6J, [TJ El E] , there is still no complete agreement as 
to what kind of distribution the ground states follow. Analytically, there is no theory 
(to the best of our knowledge) which would predict a particular limiting distribution 
for large system sizes N. Not even the width of the distribution is precisely known: 
the numerical simulations seem to suggest that the width scales as with \i w i 
and this is supported by some heuristic arguments [101 2j . Other arguments favour 
l 1= \ [HI 112 ■ (If this problem fell into the Tracy- Widom universality class, the width 
would scale as TV 1 / 3 [B]. This seems to be ruled out by the numerical results.) 

In addition to the ground state energies and their sample-to-sample fluctuations 
one can also consider the sample-to-samplc fluctuations of the free energy at a finite 
temperature within the spin glass phase. The natural expectation would be that in 
the low temperature phase these free energies fall into the same universality class 
as the ground state energies (although this has never been proved). However, the 
distribution of the free energies appears as inaccessible as the one of the ground state 
energies. Part of the difficulty lies in the fact that the variance of the distribution 
scales with a subextensive power of N. In order to calculate subextensive terms, it 
is usually necessary to go to higher than the leading order in the loop expansion of 
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the spin glass problem. Due to the massless modes present throughout the spin glass 
phase this has so far been impossible in the Sherrington-Kirkpatrick model. For the 
finite-dimensional spin glass, this problem is not so severe and the fluctuations could 
be calculated [T31 E] • They are however fundamentally different from the ones in the 
Sherrington-Kirkpatrick model, which we will be considering here. 

In this paper we present a way which circumvents this obstacle by constructing 
an exact relation between the free energy fluctuations and bond chaos in spin glasses. 
This connection has been briefly described in [15] and we present the details of the 
calculation here. Using this relation, the width of the distribution can in principle be 
calculated by calculating chaos. A part of the necessary aspects of chaos has been 
calculated in [16], and the results from that paper will be sufficient to derive the 
upper bound \i < \ here. For the full answer, it will be necessary to calculate more 
complicated objects such as simultaneous 4-replica overlaps. We will not be able to 
solve this formidable problem here. 

This paper is organized as follows. In Sec. [21 we briefly review a few methods and 
results from the literature in order to compare them with our own theory later on. 
We derive the connection to bond chaos in Sec. [3] The fluctuations above and at the 
critical temperature, as well as the bound \x < \ in the low temperature phase are 
calculated in Sec. HJ We end with a conclusion in Sec. [5] 



2. Above and at the critical temperature 

In this section we review a few methods and results above and at the critical 
temperature from the literature for completeness and for comparison with our own 
results later on. 

Analytically, the free energy fluctuations of any disordered system can in principle 
be found with the replica method. Given the partition function Z of a system of size 
N, it can easily be shown that a Taylor expansion of log Z n in powers of n yields 

]ogZ« = -n/3F N + — AF 2 N +-.., (1) 

where the overbar means the average over the disorder, (3 = l/fc^T is the inverse 
temperature, Fn is the average free energy at system size N, and AFn denotes its 
sample-to-sample fluctuations. The dots indicate higher order cumulants. Using the 
replica formalism, one can calculate Z n for integer n and try to continue the resulting 
expression to real (or, indeed, complex) n and isolate the coefficient of the second 
order term which represents the fluctuations. In the case of the Ising spin glass this 
works very nicely above and at the critical temperature. It is straightforward to show 
with the standard replica formalism for the mean-field spin glass |17] that in the high 
temperature phase (/3 < 1), where the saddle point is replica symmetric and its Hessian 
has only strictly positive eigenvalues, the fluctuations are 

(3 2 AF 2 = -\ log(l - /3 2 ) - y + 0(1/N) (2) 

[TT1 1TB] . As the critical temperature T c is approached (f3 f 1/T C = 1), this 
expression diverges, which indicates that the fluctuations at the critical point must 
also diverge with N. A straightforward extension of the calculation in [18] shows that 
the fluctuations at the critical point are 

(3 2 AF 2 N = ^ log AT + 0(1), (3) 
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which does indeed diverge as N — > oo. As a check, we can rederive this result from 
Eq. @ by isolating the divergent part, — \ log(l — /3), and replacing 1 — (3 ~ r (where 
t = T ^ Tc is the reduced temperature) by xN^ 1 ^. The variable x = tN 1 ^ 3 is the 
correct scaling combination in the critical region [TBI . Keeping x fixed and letting 
N tend to infinity in —~log(xN~ x / 3 ) results in Eq. ©. 

In the low temperature phase, the situation is much more complex and there are 
no reliable analytical results. 



3. Interpolating Hamiltonian 

In this section we will derive two different exact expressions for the fluctuations in 
terms of chaos using interpolating Hamiltonians. While the calculation presented 
here is in spirit similar to the one by Billoire [20] . there is an important difference. 
Here, we do not interpolate between a big system and two small systems (see also |21j ) 
but between two equally big systems. This may seem strange at first sight but is in 
fact the key to making any analytical progress on this particular problem. 



3.1. First route to chaos 

Consider the following interpolating Hamiltonian: 



n t = -y^r ^ JijSiSj ~ V at ^ J '^ SiSj (4) 

with N Ising spins Sj, < t < 1 and Jy, J[: independent Gaussian random variables 
with unit variance. The parameter t interpolates between one spin glass system (t = 0) 
and a statistically independent, but otherwise identical one at t = 1. It is important to 
note that also for each other value of t the Hamiltonian describes a normal spin glass, 
the coupling constants being \f\ — tJij + VtJ^j which are Gaussian random variables 
with unit variance. 

The partition function of this Hamiltonian is Z t — Tr exp(— (3Tit) and the free 
energy is (3F t — — log Z t . The sample-to-sample fluctuations of the free energy of the 
SK model can be obtained in the following way. Denoting the average over all coupling 
constants Jy and J^- (and later also J"j and others) by E ■ ■ •, we have 

^(logZx-logZo) 2 ^ 2 ^!-^) 2 (5) 

= (3 2 (E Ff - 2E FiF + E F%) (6) 

= 2/3 2 (F2-F 2 ) (7) 

= 2/? 2 Ai4. (8) 

The penultimate step follows from the fact that E i* 1 - 2 ~ E Fq =: F 2 is the disorder 
average of the squared spin glass free energy and that the average E F\F = 

2 

(EF\){EFq) =: F factorizes into the square of the averaged free energy since the 
coupling constants in the two Hamiltonians Tlo and Tli are independent. Using this 
formulation and the idea developed in [21] to represent log Z\ — log Zq by differentiating 
with respect to the interpolation parameter t and immediately integrating again, the 
fluctuations can be written as 

2f3 2 AFi r =E{\ogZ 1 -logZ ) 2 = J^ dt J dr E -| log Z t ^- log Z T .(9) 
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In Appendix A| it is shown how to manipulate this expression in order to arrive at 



Eq. (|A.14p . which is repeated here for convenience. Note that this equation is exact. 

p 9 i v 9 , ry N 2 p A f n VT~t^F VT=?Vi\ _., 2 2 . , 2 2 
fit logi % log ^ = 16" I 2 - vVfl - VWT^t ) <(<& - - 923)) 

7V/3 2 { / 2 \ 1 



+ iM Ete> -«J- (10) 

The symbols q a \, are overlaps between independent replicas with different interpolation 
parameters, 

i 

In Eq. (jlOp replicas 1 and 2 have parameter i and replicas 3 and 4 have parameter 
r. The angular brackets (• • •) denote the thermal average of a system of independent 
replicas with the appropriate interpolation parameters. 

We have thus established a connection between the fluctuations and the overlap 
between replicas with different interpolation parameters. The last important step is 
to realize that for any given value of t, Tit represents a normal mean-field spin glass 
with Gaussian couplings just like any other. The overlap qi3 between two replicas 
with different interpolation parameters is therefore an overlap between two normal 
spin glasses with identical bonds (if t = r), uncorrelated bonds (if t = 0, r = 1 or vice 
versa) or related, but not equal bonds (for anything in between). This immediately 
shows the connection to chaos in spin glasses. Chaos concerns the question how the 
equilibrium states of two initially equal systems are related when a small perturbation 
is applied to one of them, e.g. a small change of temperature (temperature chaos) or a 
perturbation of the bonds (bond chaos). When there is chaos, the equilibrium states 
are completely unrelated and the overlap is (in the thermodynamic limit), no matter 
how small the perturbation. In our case, we are dealing with bond chaos. 

Let t and r be given and let the coupling constants of Tit be the reference 
configuration of bonds: Kf, := a/1 — tJij+y/tJ^. The coupling constants belonging to 
TL T are Kij — \/l —rJij+ \frJ[j ■ Since the Jy and J[a are Gaussian random variables, 
so are Kfj and Kij (also with unit variance). Their correlation is Ej t j/KfjKij = 



\/l — ty/1 — t + s/tr. Instead of using and J[ ' • as the basic independent random 
variables one could also use Kfj, introduce new Gaussian random variables KL and 
take Kfj and K'^ as the building blocks of the random variables. We can then write 
the bonds pertaining to TL T as 

KiAt) = -=^=+ ■ 10 , (12) 

such that the correlation between and Kij(e) is E K^Kij{e) — ^^ +e2 ■ in order 
that the bonds Kij(e) are statistically equivalent to the original bonds of 7i T , the 
correlation must be equal to the correlation obtained before, so 

' = VI -Wl - T + VtT- (13) 



Thus we see that the disorder average of the overlap qi3(t, r) is only a function of the 
"distance" e of the coupling constants, i.e. E (qf 3 {t, r)) = E (qf 3 {e)} is only a function 
of e, not of t and r indepently. The same applies of course for products of overlaps 
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such as E (qf 3 (t,T)q% 3 (t,T)) — E (<Zi 3 (e)<Z23( e ))- The distance e varies between and 
oo. 

In order to obtain the fluctuations, we must integrate Eq. (|28p over t and r, 
according to Eq. But since the overlaps only depend on e, it is useful to make 
a variable substitution and go over to e and z :— vH- e 2 \fr. We first note that the 
integral J dt J Q dr • can be restricted to the range r < t due to symmetry, provided 
a factor of 2 is inserted. We can then make the substitution and obtain 

p AF "-—[r 



' def 1 (e)E((ql-ql)(ql 3 - q l 3 ))+^ 1^ de 9l (e) (e <<&) - 1) (14) 



where 



1 i 



91 (e) = / dzjx— (16) 



with the Jacobian 



4z 



^ = 7TT 2 u (^1 + e 2 - * 2 + z)(Vl + e 2 - ^ - «)■ (17) 
(1 + e z p 

The old variables t and r, expressed in terms of the new ones, are 

t = ( eVTT ^f + Z )\ (18) 



1 + e 2 



(19) 



1 + e 2 

The integrals in Eqs. (fT5")) and (fTB")) can be evaluated explicitly and we find 

/l(e)= (T^ arcsin 7rW (20) 
gl(£)= (i + ^/ 2 arcsin 7iT?- (21) 

Eq. (fl"4)) is our first important result. It is exact and connects the fluctuations with 
bond chaos. If it were possible to calculate bond chaos (and it was shown in [TB] that 
at least for the 2-replica overlaps it is possible), the flucutations follow immediately 
since the functions /i(e) and <?i(e) are "harmless" (Eqs. (f2T)]) and (|2"Tj) ). Note that 
/i(e) and <7i(e) are nonnegative and ((qf 3 — gxi)(Qi3 ~ I23)) 1S a ^ so nonnegative (this 
is shown in |Appendix A[ ). The first term in Eq. ([M]) is therefore negative. Hence the 
second term is an upper bound for the fluctuations. 



3.2. Second route to chaos 

There is another way to represent the fluctuations with interpolating Hamiltonians 
than Eq. f8j which will lead to a second expression for the fluctuations. Introducing 
the Hamilontian H.' t defined by 

K = -fj E J wi - /^E ( 22 ) 

i<j i<j 
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which only differs from TL t by the second set of coupling constants which are again 
independent Gaussian random variables with unit variance, we can write 

E (log Z x - log Z ) (log Z[ - log Z' ) = p 2 E (F 1 - F )(F[ - F*) (23) 

= I3 2 E (FxF[ - F\Fq - F Q F[ + F Fq) (24) 

= /3 2 (F2-F 2 ) (25) 

= P 2 AF%, (26) 

where Z' t and F[ are the partition function and the free energy pertaining to Ti.' t . The 
fluctuations can be represented by a double integral, as above, 

1 AF 2 = J dt J Q dTE^ log Z t log Z' T . (27) 
Proceeding precisely as above and in Appendix | Appendix A[ we get 

E^iogz,— iogz; = - - <&)) 

Replicas 1 and 2 have Hamiltonian Tit and replicas 3 and 4 have 7i^.. 

Integrating over t and r gives us the fluctuations, and again the overlaps do not 
depend on t and r separately but only on the distance e. The distance is here not 
given by Eq. (fT3|) but is slightly different due to the independence of the J's and J"s. 
Arguing similarly as above, e is found to be related to t and r by 
1 



= y/T^tVl^r. (29) 

Making a change of variables to eliminate r in favour of e yields 

Af2o4 roc r e 2 /(l+e 2 ) „ 

/? 2 A^ = £UL j( de j o dt — ^—Eifa q lM 3 <&)) 
n r 2 r 00 /- e2 /(i+e 2 ) O f , / 1 \ 



such that 

/3 2 Aff = ^ r def 2 (e)E(( q l 3 - q 2 u )( q f 3 - q l 3 )) > X 1 



16 / n " " '"'^ 4 



l°°deg 2 (e) (e(^) - i 



This is the second result for the fluctuations. It has precisely the same structure as 
Eq. (|14p. The only difference are the weight functions under the integrals, which are 
given by 

_ 26lQg(l+6 2 ) 

i2 ^> - (l +c 2)2 ^ 

elog(l + e 2 ) , . 

^ = ( 1 + £ 2)3/2 ' ( 33 ) 

and the sign of the first term, which here is positive. 
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4. Calculation of the fluctuations 



Having established the connection to chaos, we can proceed to calculate the 
fluctuations by calculating E (qf 3 ) and E ((qf 3 — gf 4 ) {q\ 3 — 9 2 3 ))- The former can 
be accomplished by taking the bond averaged probability distribution P e (q) of the 
overlap q for bond chaos, which has been calculated in [16]. Averages taken with this 
probability distribution will be denoted by [• • -]o- The latter is more difficult and will 
be postponed to a later publication. It requires the joint probability distributions 
-P e 123 (913, 923) and P 1234 (gi 3 , q 2 i). However, above and at the critical temperature, 
there is no replica symmetry breaking, hence these probability distributions factorize 
into P e 123 (<zi3,<72 3 ) = P e (qi 3 )Pe(q23) and P £ 1234 (gi 4 , 923 ) = P e (914)^(923) such that 

E ((ql 3 - 9x4X913 ~ 9 2 2 3 )> = ll% ilX- (34) 
We will be able to calculate this. Below the critical temperature, on the other hand, 
we will have to content ourselves with an upper bound of the fluctuations which is 
given by the second integral in Eq. (fl4|) . 



4--1- Above the critical temperature 

The nonnormalised probability distribution of the overlap q for bond chaos, R e (q), 
above the critical temperature is [16] 

R°( q ) = e -N(4^)+otf)) (35) 



with hU) = 1 - -4=^. 

For large N, we can easily calculate [q 2 ]o and [q 4 ]o via steepest descents. At 
leading order, the terms of order q A and higher in the exponent do not contribute. 
Defining q n :— J dqq n R e (q) (the upper bound may be set to oo as this only 
introduces exponentially small errors), we get 

UN, , \- (n+1)/2 fn + l 



such that 



1n = ^\ Y h(e)) r ( — ^ — J (36) 



[9 2 ]o = ^ = -f^pr, (37) 
9o Nh(e) 

fe 4 ]o = - = ^n- (38) 
q N 2 h' ! {e) 

This allows us to write down two equations for the fluctuations from our two routes 
to chaos, Eqs. (fl"4|) and (f3"Tj) . namely 



?2 a Z7>2 



The second of these expressions can be evaluated explictly, with the result 

/3 2 AF 2 =-Ilog(l-/3 2 )-^, (41) 

in accordance with Eq. @. The author is currently unable to calculate the integrals 
in Eq. (|39|) but numerical checks show that they give precisely the same result. 
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4-2. At the critical temperature 

The nonnormalised probability distribution R t (q) precisely at the critical temperature 
is given by [TB] 

~ j e -N q *h( e )/2 N -i/ 6 <<; £ ■ ( 42 ) 

Define as before q n — J^ dqq n R e {q). Then we find 

= f i (i^£)- ( " +1)/3 r(li±i) e«7V- 1 /6 

qn ~\ i(^ Me) )-(" +1 )/ 2 r(ii±i) 7v-V6 <<£ ' 



(43) 



such that 



and 



x " 1-2/3 ^ e«7V- 1 /6 
®~1 (fMe))" 1 ^ 7V~ 1 / 6 « 



r 2i 92 I V 6 ) TWj 



r 4i y4 I V 6 / r(i) ^ /.,.-, 



e 



r(|) 

Now we can evaluate Eq. (fBTj) . Plugging [g 2 ]o into the second term of that equation 
yields a constant of order 1 which is not of interest and will therefore not be calculated 
explicitly. The first term, however, is important. Splitting the integral into two parts 
we get asymptotically 

— J & / 2 ( e )(fe]«-te]o) = ^y o def 2 {e) r2( | } ^— j (46) 

TV 2 /? 4 f 00 1 /AT \~ 2 

' &/ 2 (e)- -h( c ) . (47) 



16 Jiv-i/e 2 \ 2 

The first of these integrals yield a constant (independent of AT). The second one, 
however, gives a logarithm at the lower bound such that we get (with /2(e) = 
2e 3 + C(e 5 ), h(e) = e 2 /2 + C(e 4 ) and (3 = 1 as we are at the critical point) 

p 2 AF* = ~logiV + C9(l). (48) 

This is precisely the known result. 

It is interesting to note that we would not have been able to obtain this result so 
easily from our first route to chaos, Eq. (|14[) . as both integrals in that expression grow 
with some power of N, and only their difference cancels out the leading behaviour and 
leaves a logarithmic divergence. In order to actually calculate this, we would need 
subleading corrections to the integrals, which would be very hard to obtain indeed. 



4-3. Below the critical temperature 

Now we turn to the low temperature phase. We will not be able here to solve 
the complete problem since -P e 123 (g , i3, 923) and P e 1234 ((?i4, 923) do not factorize in the 
symmetry breaking phase. In [22J, [23] it has been shown how to break down these 
probability distributions but the results only apply for e = 0. Instead, we focus on the 
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second term in Eq. Q14p since it only requires P e ((?i3) and provides an upper bound 
for the fluctuations. 

From |16j we get the nonnormalised probability distribution of q in the low 
temperature phase, which is 



where 



Re(q) 



6{x) 



% - <?ea) 

-N Cl e 2 q 3 



-Nf{e)<f 



e « N-V 2 
N~ 1 / 2 < e < A" 1 / 5 
A" 1 / 5 < e < e Q 
e Q < e 



1 



X < 

x > 



(49) 



(50) 



with some (unimportant) positive constant cq and (?ea is the Edwards- Anderson order 
parameter, such that 



i(^ Cl e 2 )-(" +1 )/ 3 r(2±i) 

i(7Vc 2 e 3 )-(" +1 )/ 2 r(2±i) 

i(7v/( £ ))-(«+ 1 )/ 2 r(2±i) 



e « A~ 1//2 
N- 1 ' 2 < e< A" 1 / 5 
A" 1 / 5 « e < e 
e < e 



(51) 



and 



const 

(Ae 3 ) 
(Nf(e)) 



2/3 
1 

1 



e « iV- 1 / 2 
A -1 / 2 « e « AT-V5 
A" 1 / 5 < e < e 
eo < e 



(52) 



Note the discussion in [16] about why the probability distribution for e <C A" 1 / 2 
does not coincide with the true distribution for the Sherrington-Kirkpatrick model. 
However, this discrepancy only changes the value of [<; 2 ]o for small e. It does not 
change the qualitative behaviour of [<7 2 ]o as a function of e. 

We can estimate the integral J °° de <?i(e) (E(qf 3 ) — j?) from Eq. (fl4|) by first 
neglecting the 1/A-term under the integral as we are only interested in the leading 
behaviour. We can also neglect the contribution of the integration from eo to oo since 
it will only be of order 1. We also note that we can combine the regions e <C A -1 / 2 
and A~ 1/2 < e < A~ 1/5 by writing [q 2 ] = T{N 1 / 2 e) with a scaling function T{x) 
with the properties F(x) — ► const, (x — + 0) and ZF{x) ~ x~ 4 / 3 (a; — * oo). We then 
obtain for the first part of the integral (expanding the function g\{e) for small e) 



A/3 2 



= N 1 ' 2 ^ 
4 



degi(e)[q 2 



A/3 2 



deT{N l ' 2 e) 



N 



3/10 



dxT{x) ~ A 1/2 . 



The next part of the integral is 

A/3 2 r ta 



degi(e)[q ] 



A/3 2 



_J iv 2 /5 

at-i/5 Ae 3 



(53) 



(54) 



4 Jat-i/5 4 
This contribution is smaller than the one we just had and may be neglected. 

The final answer for the fluctuations in the low temperature phase is therefore 

(3 2 AF^ < const, x A 1/2 , (55) 
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i.e. we get the upper bound 

H < ~. (56) 

5. Conclusion 

We have shown that the free energy fluctuations in the Sherrington-Kirkpatrick model 
can be expressed in two different ways in terms of bond chaos, Eqs. (fT4]l and (f3Tj) . both 
of which are exact. The first formulation consists of a difference of two positive terms 
while the second is a sum of positive terms. We have derived an upper bound of the 
fluctuations using the first formulation, resulting in /i < j. In the future, the second 
formulation will be more useful because it allows direct access to the fluctuations when 
4-replica overlaps are calculated, either numerically or analytically, since it is easy to 
see that the second integral in Eq. (f3Tj) is subdominant and only the first integral 
needs to be evaluated in order to obtain the leading behaviour of the fluctuations. 
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Appendix A. Evaluation of the interpolating Hamiltonians 

In this appendix we show the details of the derivation of the connection to chaos. The 
partial derivatives in Eq. © evaluate to 

~ log^ = i Tr ^-!L= g Ji jSiSj - E cxp(- W (A.1) 

1 p d\ogZ t 1 x - d\ogZ t 

~2t^ ij dJ>., 2(1 - i) oj 

It remains to deal with the average over the disorder in 



i<j,k<l \ 



1 T/ d\ogZ t 1 d\ogZ t 



" djr 2(1 -t) « 0.1, s ) 

Let's look at the first term of the product under the sum, E J' n JL dl °f, Zt 9 '°f, ZT . 
We can integrate by parts with respect to, say, JL (a standard trick [21]) in the form 

./...^.-'-•/•...^Ji.-i^Ji. (A.4) 

where the • stands symbollically for any function of the and J[y The derivative 
can be moved to the right using the product rule so 

EJ(jJ' kl . = E U ij)m +Jj a JL r ).. (A.5) 
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Here, the second term can once again be treated by integration by parts, this time 
with respect to J' kl . The result is 

EJljJ'ki • = E (%),(«) + ^r^r ) • • (A.6) 

\ kl ij J 

The same procedure can be applied to the remaining terms in Eq. (|A.3|1 , with the 
difference that the terms that mix Js and J's do not have the 5uj)jkl)) resulting in 

Id d d log Z t d log Z T 1 Odd log Z t d log Z T 



E §- t l °sZ t ^o g Z T = E J2 

i<j,k<l 



UrdJ' kl dJ' i3 - 8J[ 3 8J' kl 4t(l-r)0J w 0J£ 94 dJu 
1 d d dlogZ t dlogZ T 1 d d d log Z t d log Z T ' 



A(l-t)TdJ' kl dJ l3 dJij 3J' kl 4(l-i)(l-r)dJ w dJy dJu dJ H 
1 ^ d\ogZ t d\ogZ T 1 d\ogZ t d\ogZ T 

The derivatives which appear in this expression are related to spin averages. One 
finds for example 

aio g z t p 



dJij -^^{s iSj)t , (A.8) 

where (• • -) t stands for the thermal average, to be taken with the interpolation 
parameter set to t. Similarly, for two derivatives, one obtains for instance 

d 2 log Zt 1 1 r ,. 

qj qji = ]yV 1 - tVt((s l s i s fc s;) t - {s t s j ) t {s k si)t). (A.9) 

In general, each derivative with respect to a J or J' generates averages of the spins 
with the indices involved and brings down a prefactor fiy/T^t/y/N (for J) or (3y/iy/N 
(for J'). Fortunately, two derivatives of log Z t are all we need because when Eq. (|A.7[) 
is evaluated, all terms containing higher order derivatives drop out. This is left as an 
excercise for the reader. Only the following terms survive: 

E — \ogZ t —\ogZ T = — — 2 - 



&t dr AN 2 V VtVT^T y/^VT~t, 

X£ ^ ((SiSjS k Sl) t ~ (SiS^tiskS^^dSiSjSkS^r - (SiS^riskS^r) 
i<j,k<l 

[3 2 

+ WJtT Z f-! E (fii8 ^ 8i8 ^ T 

+ W7 = 7T =^ E E M*Mr. (A.10) 

l<j 

In this equation, the last term is equal to the penultimate one due to symmetry under 
the exchange t — > 1 — t and r — > 1 — r. In this equation, we can let the sums run 
unrestrictedly over i,j,k,l by introducing a factor of \ for the first sum and a factor 
of \ and a correction for the diagonal terms in the second sum, resulting in 

E — \ozZ t — \ogZ 1 - 

OT 



dt 6 l dr 6 r 16A^ 2 V WT^r Jty/T=l, 

X£ }X(SjSjS k Sl) t - (s l S j } t (skSl}t)((SiS 3 SkSi) T - (SiSj) r (s k Sl) T ) 



ijkl 
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(X>(^M^t-aJ • (A.ll) 

We can write J2ij( s i s j)t( s i s j}r as N 2 (( jj J^i s i* s ? T ) 2 )> i- e - as a square of the spin 
overlap 

?i3(«,T)=i^>f s r (A.i2) 

i 

between two replicas labelled 1 and 3 with different interpolation parameters t and r. 
The labels 1 and 3 have been chosen because we will shortly need two more replicas 
which will be assigned the labels 2 and 4. Replicas 1 and 2 are then understood to 
have interpolation parameter t and replicas 3 and 4 to have parameter t. The angular 
brackets (• • •) without subscript indicate the thermal average of a system comprising 
independent replicas with interpolation parameters t and r. 

A similar decomposition in replicas can be made in the first part of Eq. (|A.11|) , 
but here two more replicas are needed. We find 

^^({SiSjSfcSjjt - (SiS^tiSkS^^dSiSjSkS^r - (SjS j) T (s k S[) T ) 
ijkl 



1 W/ l,t l,t l.t l,t\ / l,t l,t\ / 2,t 2,t\\fl 3,t 3,r 3,r 3,T\ / 4,r 4,t\ / 3,r 3,r\\ 
= ]V4Z^^ S i S J S fc S i >~\ S * S J S l >>^ S i S 3 S k V )-\ S i S j )( S k s l )) 

ijkl 

= ((Qi3 ~ <fid(Qi3 ~ 

As a by-product, we see in the last line that the expression ((qf 3 — qi^iqf^ — Q23)) is 
nonnegative. The end result is finally 

v 8 , V ^ 2 /3 4 / \/T=V? >/l=Wt\ „„ 2 2 x/ 2 2 nx 



4V£r V AT 
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